Minimax Estimation of Large Covariance Matrices under l1-Norm
نویسندگان
چکیده
Driven by a wide range of applications in high-dimensional data analysis, there has been significant recent interest in the estimation of large covariance matrices. In this paper, we consider optimal estimation of a covariance matrix as well as its inverse over several commonly used parameter spaces under the matrix l1 norm. Both minimax lower and upper bounds are derived. The lower bounds are established by using hypothesis testing arguments, where at the core are a novel construction of collections of least favorable multivariate normal distributions and the bounding of the affinities between mixture distributions. The lower bound analysis also provides insight into where the difficulties of the covariance matrix estimation problem arise. A specific thresholding estimator and tapering estimator are constructed and shown to be minimax rate optimal. The optimal rates of convergence established in the paper can serve as a benchmark for the performance of covariance matrix estimation methods.
منابع مشابه
COMMENTS on “MINIMAX ESTIMATION OF LARGE COVARIANCE MATRICES UNDER l1-NORM”
Professors Cai and Zhou are to be congratulated for making yet another important contribution to the development of theory and methodology for highdimensional covariance matrix estimation. In this article, hereafter referred to as CZ, they considered large covariance matrix estimation under the matrix l1 loss for both sparse and bandable covariance matrices. As is common in the current literatu...
متن کاملMinimax optimal estimation of general bandable covariance matrices
Cai et al. (2010) [4] have studied the minimax optimal estimation of a collection of large bandable covariance matrices whose off-diagonal entries decay to zero at a polynomial rate. They have shown that the minimax optimal procedures are fundamentally different under Frobenius and spectral norms, regardless of the rate of polynomial decay. To gain more insight into this interesting problem, we...
متن کاملOptimal Rates of Convergence for Sparse Covariance Matrix Estimation By
This paper considers estimation of sparse covariance matrices and establishes the optimal rate of convergence under a range of matrix operator norm and Bregman divergence losses. A major focus is on the derivation of a rate sharp minimax lower bound. The problem exhibits new features that are significantly different from those that occur in the conventional nonparametric function estimation pro...
متن کاملOptimal Rates of Convergence for Sparse Covariance Matrix Estimation
This paper considers estimation of sparse covariance matrices and establishes the optimal rate of convergence under a range of matrix operator norm and Bregman divergence losses. A major focus is on the derivation of a rate sharp minimax lower bound. The problem exhibits new features that are significantly different from those that occur in the conventional nonparametric function estimation pro...
متن کاملEstimating Structured High-Dimensional Covariance and Precision Matrices: Optimal Rates and Adaptive Estimation
This is an expository paper that reviews recent developments on optimal estimation of structured high-dimensional covariance and precision matrices. Minimax rates of convergence for estimating several classes of structured covariance and precision matrices, including bandable, Toeplitz, and sparse covariance matrices as well as sparse precision matrices, are given under the spectral norm loss. ...
متن کامل